IP address and domain name automation of virtual infrastructure

ABSTRACT

Provisioning an Internet Protocol address is disclosed. A request to provision an Internet Protocol address to a virtual resource is received. An Internet Protocol address is automatically determined to allocate to the virtual resource. An Internet Protocol Address Management appliance is used to automatically allocate the determined Internet Protocol address to the virtual resource.

BACKGROUND OF THE INVENTION

With advances in cloud computing and virtualization, a systemadministrator is able to easily add or remove a virtual resource, suchas a virtual machine, device or network, as needed to dynamically matchcomputing needs. Because virtualization allows a single physical machineto host a large number of virtual resources, it is not uncommon for asingle organization to utilize hundreds of virtual machines. Themanagement of these virtual resources has been traditionally difficult.Traditionally, allocation of network parameters such as an InternetProtocol (IP) address or a Domain Name System (DNS) registrationrequired a network engineer to manually look up available networkparameters and assign an available parameter to a requestor. This manualprocess could potentially take days. Especially in a virtual cloudenvironment where a large number of virtual resources needs to bedynamically created and destroyed on a relatively short time frame,manually assigning IP addresses or manually performing DNS registrationupdates would be extremely inefficient and prone to errors. Therefore,there exists a need for a better way to manage network parameters of avirtual resource.

BRIEF DESCRIPTION OF THE DRAWINGS

Various embodiments of the invention are disclosed in the followingdetailed description and the accompanying drawings.

FIG. 1 is a block diagram illustrating an embodiment of a virtual cloudenvironment.

FIG. 2 is a block diagram illustrating an embodiment of a communicationinterface between an IPAM appliance and a virtual cloud.

FIG. 3 is a flowchart illustrating an embodiment of a process forcollecting infrastructure metadata information.

FIG. 4 is a diagram illustrating an example of a graphical interfacedisplaying infrastructure metadata information in a graphical format.

FIG. 5 is a diagram illustrating an example of a graphical interfacedisplaying infrastructure metadata information organized in ahierarchical folder format.

FIG. 6 is a diagram illustrating an example of a graphical interfacedisplaying infrastructure metadata information associated with a virtualresource.

FIG. 7 is a diagram illustrating an example of a graphical interfacedisplaying extensible attributes associated with a virtual resource.

FIG. 8 is a flowchart illustrating an embodiment of a process forautomatically provisioning a virtual resource with an IP address.

FIG. 9 is a flowchart illustrating an embodiment of a process forregistering a virtual resource with a DNS.

FIG. 10 is a flowchart illustrating an embodiment of a process forremoving a virtual resource.

FIG. 11 is a diagram illustrating an example user interface to controland configure workflows to manage a virtual cloud environment.

DETAILED DESCRIPTION

The invention can be implemented in numerous ways, including as aprocess; an apparatus; a system; a composition of matter; a computerprogram product embodied on a computer readable storage medium; and/or aprocessor, such as a processor configured to execute instructions storedon and/or provided by a memory coupled to the processor. In thisspecification, these implementations, or any other form that theinvention may take, may be referred to as techniques. In general, theorder of the steps of disclosed processes may be altered within thescope of the invention. Unless stated otherwise, a component such as aprocessor or a memory described as being configured to perform a taskmay be implemented as a general component that is temporarily configuredto perform the task at a given time or a specific component that ismanufactured to perform the task. As used herein, the term ‘processor’refers to one or more devices, circuits, and/or processing coresconfigured to process data, such as computer program instructions.

A detailed description of one or more embodiments of the invention isprovided below along with accompanying figures that illustrate theprinciples of the invention. The invention is described in connectionwith such embodiments, but the invention is not limited to anyembodiment. The scope of the invention is limited only by the claims andthe invention encompasses numerous alternatives, modifications andequivalents. Numerous specific details are set forth in the followingdescription in order to provide a thorough understanding of theinvention. These details are provided for the purpose of example and theinvention may be practiced according to the claims without some or allof these specific details. For the purpose of clarity, technicalmaterial that is known in the technical fields related to the inventionhas not been described in detail so that the invention is notunnecessarily obscured.

Automatically and programmatically provisioning an IP address andperforming a DNS registration for a virtual resource (e.g., a virtualmachine, a virtual entity, a virtual device, a virtual network, avirtual switch, a virtual host adaptor, a virtual appliance, or anyother element of a virtual cloud) is disclosed. In some embodiments, anInternet Protocol address management (IPAM) appliance manages InternetProtocol (IP) addresses of one or more virtual resources in a virtualcloud environment in addition to managing IP addresses for physicalservers and devices. For example, by communicating with the IPAMappliance, an IP address can be automatically obtained, updated, orreleased for a virtual resource. In some embodiments, DNS registrationis automatically managed for one or more virtual resources. For example,a DNS record is automatically updated for a virtual resource, asrequired.

In an example virtual cloud environment with virtual machines beingdynamically created and destroyed, it is desirable to be able todynamically obtain information about existing virtual machines in thevirtual cloud environment to more efficiently manage them. In someembodiments, virtual infrastructure cloud metadata information iscollected from the virtual cloud environment. The collected metadatainformation may be organized and/or outputted (e.g., on a display of auser). For example, the collected metadata information includesidentity, location, and attribute information about one or more virtualresources (e.g., a virtual machine, a virtual entity, a virtual device,a virtual network, a virtual switch, a virtual host adaptor, a virtualappliance, or any other element of a virtual cloud) in a virtual cloudenvironment. In some embodiments, the collected metadata information isorganized into hierarchical groupings (e.g., hierarchical folderscontaining collected metadata information). In some embodiments, thecollected metadata information is stored in a storage that includesinfrastructure metadata information about both virtual resources andphysical resources.

FIG. 1 is a block diagram illustrating an embodiment of a virtual cloudenvironment. Virtual cloud 100 is a part of a virtual computing cloudenvironment and provides virtualized computing services (e.g., providingvirtualized computing and networking resources, software, and/orinformation via a network). In the example shown, virtual cloud 100includes physical servers 104, 106, and 108 that are interconnected by anetwork. Servers 104, 106, and 108 execute hypervisor (e.g., a virtualmachine manager) 110, 112, and 114, respectively. The hypervisor allowsthe server to host multiple virtual resources, such as virtual machines.In the example shown, hypervisor 110 running on physical server 104allows virtual machines 120, 122, and 124 and virtual switch 128 to behosted on physical server 104. The hypervisor also provides a virtualoperating platform that allows different operating system instances andtypes to run on the physical server hardware. Each virtual machine shownin FIG. 1 is executing a separate instance of an operating system withindividual configurations. Examples of hypervisor 110, 112, and 114include VMware® ESX/ESXi™ server and VMware vSphere™ offered by VMware,Inc. of Palo Alto, Calif. Other virtual resources may also be a part ofvirtual cloud 100, including other virtual switches, virtual hostadaptors, virtual appliances, and any other virtual or physical networkcomponents, appliances, and devices. The items shown inside virtualcloud 100 are merely examples of any number of same or different typesof component may comprise virtual cloud 100.

Internet Protocol Address Management (IPAM) appliance 102 is connectedto virtual cloud 100 via a network. An example of IPAM appliance 102includes an IPAM appliance offered by Infoblox, Inc. of Santa Clara,Calif. IPAM appliance 102 interfaces with cloud 100 to manage one ormore resources of virtual cloud 100. For example, IPAM appliance 102manages the IP addresses and DNS registrations of one or more resourcesincluded in virtual cloud 100. In another example, IPAM appliance 102stores and manages infrastructure metadata information about one or moreresources included in cloud 100. For example, IPAM appliance 102 storesconfiguration, identification, networking, and/or statisticalinformation about a virtual machine included in virtual cloud 100.

In some embodiments, IPAM appliance 102 is a virtual applianceimplemented on one or more virtual machines and/or one or more serversincluded in virtual cloud 100 or a different virtual cloud. In someembodiments, IPAM appliance 100 is a physical server appliance connectedto virtual cloud 100 via a network. Examples of the networks discussedin this specification may include one or more of the following: a director indirect physical communication connection, mobile communicationnetwork, Internet, intranet, Local Area Network, Wide Area Network,Storage Area Network, and any other forms of connecting two or moresystems or storage devices together.

FIG. 2 is a block diagram illustrating an embodiment of a communicationinterface between an IPAM appliance and a virtual cloud. In someembodiments, virtual cloud 200 includes virtual cloud 100 of FIG. 1.Infrastructure manager 230 manages at least hypervisors 210 and 212 thateach host one or more virtual machines (e.g., virtual machine 220). Anexample of an infrastructure manager is vCenter™ Server offered byVMware, Inc. Infrastructure manager 230 also manages virtualizedhardware resources (e.g., memory, processors, etc.) of physical servers204 and 206 that can be shared and allocated to any of the virtualresources hosted by the servers. In some embodiments, infrastructuremanager 230 includes and/or is in communication with global cloudmanager 240 that manages the applications and/or services provided byvirtual cloud 200. Global cloud manager 240 also may manage multiplehypervisors and/or groups of hypervisors. An example of global cloudmanager 240 includes vCloud™ Director offered by VMware, Inc.

Global cloud manager interface application 250 interfaces with globalcloud manager 240 and can be used to manage virtual cloud 200. Forexample, a network administrator can use global cloud manager interfaceapplication 250 to customize the virtual environment and virtualresources of virtual cloud 100. In some embodiments, global cloudmanager interface application 250 communicates with global cloud manager240 through a standard protocol such as Advanced Message QueuingProtocol (AMQP). In some embodiments, Internet Protocol AddressManagement plug-in (IPAM plug-in) 252 installed on global cloud managerinterface application 250 allows services of IPAM appliance 202 (e.g.,management of IP addresses and DNS registration for virtual resources)to be utilized by global cloud manager 240. In some embodiments, IPAMplug-in 252 enables IPAM appliance 202 to interface with global cloudmanager interface application 250 through a web service or applicationprogramming interface (API).

In some embodiments, IPAM agent 254 is connected with and/or included inglobal cloud manager 240 and listens to messages communicated to andfrom global cloud manager 240 to detect information to be passed to IPAMappliance 202. This allows IPAM appliance 202 to interface with globalcloud manager 240. In some embodiments, a stand-alone interfaceapplication interfaces between global cloud manager interfaceapplication 250 and IPAM appliance 202. An example of IPAM appliance 202includes an IPAM appliance offered by Infoblox, Inc.

In some embodiments, global cloud manager interface application 250allows a workflow to be defined and/or at least in part processed. Theworkflow programmatically defines a series of one or more actions to beperformed to manage virtual cloud 200. A predefined workflow may be usedperform a task that otherwise would require a set of repetitivecomponent actions to be directly used. For example, a networkadministrator may select a workflow in global cloud manager interfaceapplication 250 and execute the workflow that instructs global cloudmanager 240 to create a new virtual machine in virtual cloud 200 andautomatically obtain an IP address for the new virtual machine usingIPAM appliance 202. A workflow may include the use of one or more otherworkflows, and a plurality of workflows may be used together toaccomplish a desired task.

In some embodiments, IPAM plug-in 252 is installed into global cloudmanager interface application 250 and provides one or more workflowsand/or workflow action components that can be used to define a workflow.These workflows and workflow components may allow IPAM appliance 202 tobe used to manage one or more components/resources of virtual cloud 200.For example, IPAM plug-in 252 provides the capability to use a workflowthat uses IPAM appliance 202 to automatically assign a determined IPaddress and perform a DNS registration using the assigned IP address fora virtual machine created in virtual cloud 200.

FIG. 3 is a flowchart illustrating an embodiment of a process forcollecting infrastructure metadata information. At least a portion ofthe process of FIG. 3 may be performed by IPAM appliance 102 of FIG. 1or 202 of FIG. 2. The infrastructure metadata information may includeidentifiers, attributes, and configurations associated with a virtualresource of a virtual cloud infrastructure. For example, theinfrastructure metadata information includes one or more of thefollowing: a fully qualified domain name, an IP address, a MAC address,an operating system metadata, a virtual data center metadata, aninfrastructure manager metadata, a hypervisor metadata, a virtual entitymetadata, a virtual cluster metadata, a virtual host metadata, a hostserver metadata, a virtual switch metadata, a virtual entity typemetadata, an extensible attribute, a virtual resource containermetadata, an organization metadata, a cloud metadata, a data centermetadata, an external network metadata, and any other appropriatemetadata. Metadata includes data about data/objects. For example,metadata includes an identifier and/or an attribute. A virtual resourceof a virtual cloud, such as virtual cloud 200 of FIG. 2, is associatedwith a virtual fingerprint. The virtual fingerprint comprisesinfrastructure metadata information that identifies the virtual resourcewithin a virtual cloud environment. For example, a virtual machine in avirtual cloud is associated with infrastructure metadata informationthat identifies the virtual machine, such as an IP address, a MediaAccess Control (MAC) address, an operating system, and a virtual entityname of the virtual machines, as well as identifiers for one or more ofthe following associated with the virtual machine: a virtual datacenter, an infrastructure manager, a hypervisor, virtual entity, avirtual cluster, a virtual host, a host server, a virtual switch, avirtual entity type, an extensible, a virtual resource container, anorganization, a virtual cloud, a data center, and an external network.

At 310, infrastructure metadata information is collected. In someembodiments, the infrastructure metadata information is collected from avirtual cloud by an IPAM appliance. In some embodiments, infrastructuremetadata information is collected at a periodic interval to determineany changes to the infrastructure metadata information. In someembodiments, the infrastructure metadata information is collected atleast in part by using an API used to communicate with a virtual cloud.In some embodiments, infrastructure metadata information is dynamicallycollected as virtual resources of the cloud are dynamically altered. Forexample, the infrastructure metadata information is collected from avirtual cloud as an initial step before infrastructure metadatainformation is dynamically collected as virtual resources of the cloudare dynamically altered. In some embodiments, the information iscollected using an event generated by a virtual infrastructure (e.g.,collected from an AMQP Message).

In some embodiments the information is collected by crawling a virtualcloud to discover virtual resources and its associated infrastructuremetadata information. In some embodiments, the metadata information iscollected from various virtualization and/or networking tiers of avirtual cloud environment. For example, a first tier metadatainformation pertaining to a physical layer of the virtual resource(e.g., IP address, MAC address, host operating system) is collected fromone or more hypervisors, a second tier metadata information associatedwith a virtual resource infrastructure tier is collected from aninfrastructure manager that manages the virtual resource, and a thirdtier metadata information associated with a virtual cloud infrastructuretier is obtained from a global cloud manager that manages theinfrastructure manager. In the example of a virtual cloud solutionoffered by VMware, Inc., a Fully Qualified Domain Name, an IP Address,and a MAC address are collected from a physical network tier, metadataassociated with vCenter™, virtual Cluster, virtual Host Server, andvirtual Switch is collected from a virtual resource infrastructurelayer, and metadata associated with vCloud™, vOrganization, vDataCenter,vApp, and virtual machine is collected from the cloud infrastructurelayer.

In some embodiments, infrastructure metadata information is collectedfrom a physical network tier associated with hypervisors or physicalservers (e.g., server 204, server 206, hypervisor 210, hypervisor 212 ofFIG. 2). Information, such as a fully qualified domain name, an IPaddress and a MAC address, about a virtual resource is collected fromthe physical network tier. In some embodiments, virtual resourceinfrastructure tier metadata information is obtained from aninfrastructure manager (e.g., infrastructure manager 230 of FIG. 2). Avirtual cloud can include several infrastructure managers that eachmanages one or more hypervisors in the virtual resource infrastructuretier. For example, an infrastructure manager identifier, a clusteridentifier, a host server identifier, and a virtual switch identifierare collected from the infrastructure manager. In some embodiments,virtual cloud infrastructure tier metadata information is obtained froma global cloud manager (e.g., global cloud manager 240 of FIG. 2). Forexample, a cloud identifier, an organization identifier, a data centeridentifier, and an external network identifier, are collected from theglobal cloud manager.

In some cases, crawling the cloud to obtain infrastructure metadatainformation may not be possible or efficient in determining changes tothe infrastructure metadata information. In some embodiments, theinfrastructure metadata information is collected dynamically as anattribute of a virtual cloud is modified. For example, infrastructuremetadata information is collected as a virtual resource of the virtualcloud is created, destroyed, or modified. In some embodiments, an agentin communication with a global cloud manager may detect changes toinfrastructure metadata information as an instance of a virtual resourceis created, destroyed, or modified. Additionally, when a virtualresource is created, destroyed or modified, an IPAM appliance may beutilized to manage a network attribute (e.g., automatically allocate,de-allocate, modify an IP address) of the virtual resource. This placesthe IPAM appliance in an opportune position to detect, collect,determine, organize and otherwise process infrastructure metadatainformation as the virtual resource is created, destroyed or modified.In some embodiments, IPAM plug-in (e.g., IPAM plug-in 252 of FIG. 2)allows the IPAM appliance to communicate with a virtual cloud andprovides the IPAM appliance with infrastructure metadata information. Insome embodiments, the infrastructure metadata information is collectedwhen a service is provided by an IPAM appliance (e.g., IPAM appliance202 of FIG. 2) to the virtual cloud. For example, infrastructuremetadata information about a virtual resource is collected when the IPAMappliance is used to provision an IP address for the virtual resource.

At 312, the collected infrastructure metadata information is used toupdate a database of the metadata information. In some embodiments, thecollected metadata information is received and used to update thedatabase of infrastructure metadata information. In some embodiments, anIPAM appliance manages the database of infrastructure metadatainformation. For example, an IPAM appliance includes the database and/oris connected to the database. The database may include informationassociated with virtual resources as well as physical resources. Forexample, the database includes a database entry for each virtualresource in a virtual cloud as well as entries for physical resourcesmanaged by an IPAM appliance (e.g., physical clients and servers thathave their IP addresses managed by the IPAM appliance).

Collected infrastructure metadata information may be tied to an endpoint record in a database. End point records comprise records in thedatabase about each virtual resource in a virtual cloud. In someembodiments, infrastructure metadata information may be used to organizea group of virtual machines under a virtual data center. The virtualdata center is included in a group of virtual data centers organizedunder a single organization name. The database of infrastructuremetadata may be organized, sorted, and/or searched as desired. In someembodiments, information included in the database of infrastructuremetadata is displayed in a text, a chart, and/or a graphical form. Insome embodiments, information included in the database of infrastructuremetadata is used to generate a report.

FIG. 4 is a diagram illustrating an example of a graphical interfacedisplaying infrastructure metadata information in a graphical format. Insome embodiments, information displayed in FIG. 4 includes informationcollected in step 310 and/or stored in the database of step 312 of FIG.3. In the example shown, diagram 400 includes boxes representing a rangeof IP address from 10.65.1.0-10.65.1.255. If a resource has beenallocated one or more of the IP addresses in the range, the resource isrepresented by a colored box. In some embodiments, a first colored boxindicates a virtual resource that has been allocated to a firstcorresponding IP address and a second colored box indicates a physicalresource that has been allocated a second corresponding IP address,thereby allowing virtual machines to be displayed alongside the physicalservers. In some embodiments, different colors or shaded patterns mayrepresent different states and attributes of resources allocated to anIP address. Other indications of differences can be used includingdifferent borders, colors, fill patterns, etc. to indicate differenttypes of resources, different states or different attributes of avirtual cloud. On the right side of the shown display, a legend definingthe different indications and representations of boxes included in 400is provided. In some embodiments, by hovering and/or selecting one ofthe boxes in 400, additional infrastructure metadata informationassociated with the resource represented by the box is displayed. On thebottom of the shown display, additional infrastructure metadatainformation associated with a resource indicated by a selected box of400 is displayed. For example, discovered name 410 and MAC address 412are provided. In some embodiments, the graphical interface of FIG. 4 isaccessible via a web browser.

FIG. 5 is a diagram illustrating an example of a graphical interfacedisplaying infrastructure metadata information organized in ahierarchical folder format. In some embodiments, the graphical interfaceof FIG. 5 is accessible via a web browser. In the example shown,graphical representation of infrastructure metadata informationincluding cloud name, organization name, data center name, cluster name,virtual machine system name, and virtual resource container name isprovided in hierarchical folders. Folder 514 represents a virtual cloudnamed “vCloud.” Sub folder 516 represents an organization/user named“SoheilOrg” utilizing the virtual cloud “vCloud.” Sub folder 518represents a virtual data center named “SoheilOrgvDC” that is a part of“SoheilOrg.” Sub folder 520 represents a virtual machine named“VmSoheil” that is hosted by “SoheilOrgvDC.” Items 530 and 532 representvirtual resource container (e.g., VMware® vApp) instances running on“VmSoheil.” By selecting any of the folders and items discussed above,infrastructure metadata information associated with the selection isdisplayed. Other groupings or hierarchical organization ofinfrastructure metadata information may be displayed using folders. Insome embodiments, folders are used to group and display the virtualresources grouped by switch-ports and/or virtual local area networks.

FIG. 6 is a diagram illustrating an example of a graphical interfacedisplaying infrastructure metadata information associated with a virtualresource. In some embodiments, the graphical interface of FIG. 6 isaccessible via a web browser. In the example shown, pop-up window 600displays infrastructure metadata information of a selected virtualresource. The displayed infrastructure metadata information includes atype and build of the operating system, a MAC address, a last discoveredtime and/or date, a discovered name, a virtual datacenter name, avirtual cluster, a virtual entity name, a virtual entity type, and avirtual host.

FIG. 7 is a diagram illustrating an example of a graphical interfacedisplaying extensible attributes associated with a virtual resource. Insome embodiments, the graphical interface of FIG. 7 is accessible via aweb browser. In the example shown, pop-up window 700 displays extensibleattributes of a selected virtual resource. The extensible attributes area group of metadata information related to a virtual resource.Extensible attributes include fields that can be used to defineadditional properties of a virtual resource that may be predefinedand/or user defined. Information of the extensible attributes is notnecessarily collected from a virtual cloud. For example, the name of anorganization can be stored with an extensible attribute 716 named“vcd_vorg” that is assigned a value “SoheilOrg.” Extensible attribute716 identifies the owner organization (e.g., company/user) of a virtualresource. By providing additional fields, extensible attributes furtherfacilitate description and mapping of virtual resources to a unique anddescriptive identity in the virtual cloud. One or more extensibleattributes may be stored or associated with infrastructure metadatainformation of a virtual resource.

FIG. 8 is a flowchart illustrating an embodiment of a process forautomatically provisioning a virtual resource with an IP address. Atleast a portion of the process of FIG. 8 may be implemented on IPAMappliance 102 of FIG. 1 and/or 202 of FIG. 2. In some embodiments,provisioning an IP address to a virtual resource includes reserving anIP address to prevent the IP address from being assigned to anotherresource. The IP address may be an IPv4 or IPv6 IP address. The processof FIG. 8 may be used to provision an IP address to a variety of virtualresources including a virtual machine, a virtual entity, a virtualdevice, a virtual network, a virtual switch, a virtual host adaptor, anda virtual appliance. In some embodiments, an IPAM appliance keeps trackof the available IP addresses in the virtual cloud environment anddetermines available IP addresses to be provisioned to virtualresources. In some embodiments, infrastructure metadata collected in 310of FIG. 3 is used to determine one or more available IP addresses.

At 810, a request is received to provision an IP address to a virtualresource. The request may include information identifying the virtualresource to be assigned an IP address. For example, the request includesa MAC address and/or a Fully Qualified Domain name (FQDN). In someembodiments, the request is received from a global cloud manager (e.g.,global cloud manager 240 of FIG. 2) using an IPAM agent (e.g., IPAMagent 254 of FIG. 2). In some embodiments, the request is received dueto a workflow defined and/or processed by a global cloud managerinterface application. For example, due to the workflow, global cloudmanager interface application 250 uses IPAM plug-in 252 to request an IPaddress from IPAM appliance 202 of FIG. 2. In some embodiments, thereceived request includes a request to provision an IP address in aprovided range of IP addresses.

At 812, an IP address to allocate to the virtual resource isautomatically determined. The determined IP address is an available IPaddress in a network. In some embodiments, IPAM appliance 202 in FIG. 2automatically determines the IP address. In some embodiments,determining the IP address includes automatically determining anavailable IP address (e.g., first available IP address) using a recordof assigned and/or available IP addresses of a network. The record ofavailable IP addresses may be stored in a database of an IPAM applianceor elsewhere that is accessible by the IPAM appliance via a network orother communication connection. In some embodiments, determining the IPaddress includes determining an available IP address (e.g., firstavailable IP address) from a provided range of IP addresses. Forexample, a starting address and an ending address are provided by theuser to designate a range of IP addresses that can be automaticallyprovisioned to a virtual resource. In some embodiments, the IP addressis automatically determined due to a workflow defined and/or processedby a global cloud manager interface application. In some embodiments,the process of FIG. 2 is included in step 812. For example, thedetermined IP address is collected and used to update a database ofinfrastructure metadata associated with the virtual resource to beassigned the IP address.

At 814, the determined IP address is allocated to the virtual resource.In some embodiments, allocating the IP address includes assigning the IPaddress to the virtual resource and appropriately updating a record ofavailable IP addresses. A database of infrastructure metadatainformation (e.g., host records) may also be updated to associate thevirtual resource with the determined IP address. In some embodiments,allocating the IP address includes providing the IP address. Forexample, IPAM appliance 202 provides the IP address to global cloudmanager interface application 250 using IPAM plug-in 252 or to globalcloud manager 240 using IPAM agent 254 of FIG. 2. In some embodiments,the determined IP address is provided to a virtual machine before it isrun to allow the virtual machine to utilize the IP address to identifythe virtual machine. For example, an IPAM appliance sends a message tothe global cloud manager to assign or inject the determined IP addressto the virtual resource. In another example, the IPAM appliance sends amessage with the determined IP Address to the global cloud managerinterface application using the IPAM plug-in that sends another messageto the global cloud manager to assign or inject the IP address into thevirtual resource.

FIG. 9 is a flowchart illustrating an embodiment of a process forregistering a virtual resource with a DNS. At least a portion of theprocess of FIG. 9 may be implemented on IPAM appliance 102 of FIG. 1and/or 202 of FIG. 2. DNS is used to associate an IP address with adomain name. In some embodiments, the domain name is a FQDN that isunique in a network or virtual cloud environment. The process of FIG. 9may be used to perform DNS registration for a variety of virtualresources including a virtual machine, a virtual switch, a virtualdevice, a virtual network, a virtual entity, a virtual host adaptor, anda virtual appliance. In some embodiments, an IPAM appliance keeps trackof the available domain names in a virtual cloud environment anddetermines available domain names to be assigned to virtual resources.In some embodiments, infrastructure metadata collected in 310 of FIG. 3is used to determine one or more available domain names.

At 910, a request is received to register a virtual resource with a DNS.In some embodiments, this request is received in conjunction with or isthe same request as the request for an IP address received at 810 ofFIG. 8. In some embodiments, the request includes a desired domain name,such as a FQDN. In some embodiments, the request is received from aglobal cloud manager (e.g., global cloud manager 240 of FIG. 2) using anIPAM agent (e.g., IPAM agent 254 of FIG. 2). In some embodiments, therequest is received due to a workflow defined and/or processed by aglobal cloud manager interface application. For example, due to theworkflow, global cloud manager interface application 250 uses IPAMplug-in 252 to request IPAM appliance 202 of FIG. 2 to register avirtual resource with a DNS. In some embodiments, the request includesan IP address of the virtual resource.

At 912, the virtual resource is automatically registered with the DNS.Registering with the DNS includes associating a domain name with the IPaddress of the virtual resource. In some embodiments, registering withthe DNS includes creating or updating a DNS record of an IPAM applianceand/or a Domain Name Server to associate a domain name of the virtualresource with the IP address of the virtual resource. In someembodiments, registering with the DNS includes determining an availabledomain name and assigning the available domain to the virtual resource.In some embodiments, the virtual resource is automatically registeredwith the DNS when an available IP address for the virtual resource isdetermined at 812 of FIG. 8. In some embodiments, the virtual resourceis automatically registered with the DNS due to a workflow definedand/or processed by a global cloud manager interface application. Insome embodiments, the process of FIG. 2 is included in step 912. Forexample, a domain of the virtual resource is collected and used toupdate a database of infrastructure metadata associated with the virtualresource. In some embodiments, registering with the DNS includesappropriately updating a record of available domain names. A database ofinfrastructure metadata information (e.g., host records) may also beupdated to associate the virtual resource with its domain name.

At 914, information associated with the registration of the virtualresource with the DNS is provided. In some embodiments, providing theassociated information of the DNS registration includes providinginformation to update infrastructure metadata information. In someembodiments, providing the associated information of the DNSregistration includes providing a confirmation if the DNS registrationwas successful and providing an error indication if the registration wasnot successful. In some embodiments, providing the associatedinformation of the DNS registration includes providing the registereddomain name of the virtual resource. For example, IPAM appliance 202provides the domain name to global cloud manager interface application250 using IPAM plug-in 252 or to global cloud manager 240 using IPAMagent 254 of FIG. 2. In some embodiments, the domain name is provided toa virtual machine before it is run to allow the virtual machine toutilize the domain name to identify the virtual machine.

FIG. 10 is a flowchart illustrating an embodiment of a process forremoving a virtual resource. At least a portion of the process of FIG.10 may be implemented on IPAM appliance 102 of FIG. 1 and/or 202 of FIG.2. In some embodiments, removing a virtual resource includesdeactivating a virtual resource from a virtual cloud environment andreleasing one or more resources (e.g., IP address and domain name) ofthe virtual resource for use by others. In some embodiments, a userinitiates removal of a virtual resource from global cloud managerinterface application and the request is sent to an IPAM appliance tomanage the removal of the virtual resource. In some embodiments, thevirtual resource is removed by global cloud manager and a request issent to the IPAM appliance that a virtual resource is being removed.Then the IPAM appliance receives the request and will accordinglyexecute steps to manage the removal of a virtual resource. The processof FIG. 10 may be used to remove a variety of virtual resourcesincluding a virtual machine, a virtual switch, a virtual entity, avirtual device, a virtual network, a virtual host adaptor, and a virtualappliance. In some embodiments, an IPAM appliance keeps track ofresources used by the virtual resource to be removed. In someembodiments, infrastructure metadata collected in 310 of FIG. 3 is usedto determine one or more resources to be released.

At 1010, a request is received to remove a virtual resource. The requestmay include information identifying the virtual resource to be removed.For example, the request includes an IP address, MAC address and/or aFully Qualified Domain name (FQDN). In some embodiments, the request isreceived from a global cloud manager (e.g., global cloud manager 240 ofFIG. 2) using an IPAM agent (e.g., IPAM agent 254 of FIG. 2). In someembodiments, the request is received due to a workflow defined and/orprocessed by a global cloud manager interface application. For example,due to the workflow, global cloud manager interface application 250 usesIPAM plug-in 252 to request IPAM appliance 202 of FIG. 2 to free an IPaddress and a domain name of the virtual resource to be removed.

At 1012, an IP address associated with the virtual resource isautomatically released. Releasing the IP address associated with thevirtual resource includes freeing the IP address of the virtual resourceso that it is available to be assigned to another physical or virtualresource. In some embodiments, IPAM appliance 202 in FIG. 2automatically releases the IP address. In some embodiments, releasingthe IP address includes determining the IP address of the virtualresource using a record of assigned IP addresses of a network. In someembodiments, releasing the IP address includes removing, updating,and/or freeing an IP address record of the virtual resource to beremoved. The IP address record may be stored in a database of an IPAMappliance or elsewhere that is accessible by the IPAM appliance via anetwork or other communication connection. In some embodiments, the IPaddress is automatically removed due to a workflow defined and/orprocessed by a global cloud manager interface application.

At 1014, DNS information for the virtual resource is automaticallyupdated. In some embodiments, updating the DNS information includesdisassociating the IP address of the virtual resource with the domainname of the virtual resource. In some embodiments, updating the DNSincludes information removing or updating a DNS record of an IPAMappliance and/or a Domain Name Server to free the domain name of thevirtual resource by disassociating the IP address with the domain name.For example, a message is sent to a Domain Name Server to remove orde-register the virtual resource from the DNS records. In someembodiments, the DNS information for the virtual resource isautomatically updated due to a workflow defined and/or processed by aglobal cloud manager interface application.

At 1016, stored infrastructure metadata information about the virtualresource is automatically updated. In some embodiments, updating theinfrastructure metadata information includes updating the database of312 of FIG. 3. For example, at least a portion of infrastructuremetadata information (e.g., IP address and domain name information)about the virtual resource is deleted and/or updated. In someembodiments, updating the Astored infrastructure metadata informationincludes updating or deleting portions of information collected in 310of FIG. 3. In some embodiments, updating the infrastructure metadatainformation includes updating a list of available IP addresses and/ordomain names for a virtual cloud environment. In some embodiments, aworkflow is used to automatically and programmatically manageallocation/management of IP address and DNS registration. The workflowsallow grouping and combining of tasks to automate management of avirtual cloud environment. Workflows may be used to automate managingthe virtual cloud environment.

In some embodiments, a global cloud manager interface applicationincludes predefined and customizable workflows that provide a userfriendly interface for managing a virtual cloud environment. In someembodiments, an IPAM plug-in (e.g., IPAM plug-in 252 of FIG. 2) providesIP address and DNS management functionality to the workflows andfunctions already included in a global cloud manager interfaceapplication. In some embodiments, the IPAM plug-in includespre-determined workflows, such as workflows that perform the followingfunctionality: reserve an IP address, reserve an IP address in a range,remove a virtual machine, create a VMware® vApp configured by an IPAMappliance, and destroy a VMware® vApp in IPAM appliance records. IPAMplug-in provides an interface with an IPAM appliance that provides thesefunctions.

Actions are components that make up a workflow and represent individualsub-tasks executed to manage the virtual cloud environment. In someembodiments, actions are implemented as JavaScript™ segments that use anAPI provided by an IPAM plug-in to interface with an IPAM appliance.Examples of IPAM plug-in provided actions that can be used in anexisting workflow or used to create a new workflow include thefollowing: add virtual machine, add virtual machine in a range of IPaddresses, connect to IPAM appliance, get next available IP address, getnext available IP address from range, remove virtual machine, restartIPAM services, update virtual machine MAC address, validate IP address,add virtual machine to DNS, delete virtual machine to DNS, and updatevirtual machine to DNS. In some embodiments, in order for an IPAMappliance to connect with a global cloud manager interface application,the IPAM plug-in provides an action for connecting to an IPAM appliance.In some embodiments, connecting to an IPAM appliance includes providinga username and a password to authenticate the user's authorization touse or configure IPAM appliance services. In some embodiments, the IPAMplug-in provides actions to control the IPAM appliance from the globalcloud manager interface application, including the ability to restartIPAM appliance services.

FIG. 11 is a diagram illustrating an example user interface to controland configure workflows to manage a virtual cloud environment. In someembodiments, the user interface shown in FIG. 11 is an example of a userinterface of global cloud manager interface application (e.g.,application 250 of FIG. 2) that interfaces with a global cloud manager.In the example shown, sidebar section 1110 shows a list of availableworkflows. Window 1130 shows a graphical representation of a workflowselected from section 1110. Workflows listed section 1110 includesadditional workflows added by an installed IPAM plug-in. Selectedworkflow 1112 named “Create vApp with VM networks configured via IPAM”has been provided by the IPAM plug-in. Window 1130 shows a workflow in aflowchart graphical representation. Actions that make up workflows areshown as blocks in the flowchart representation. The arrows connectingthe blocks represent flow of actions in the workflow. For example,“Instantiate a vApp” action 1114 represents the task of creating aVMware® vApp. “connectIpam” Action 1116 represents the task ofconnecting to an IPAM appliance and authenticating a user. Variouscombinations of action blocks and flow arrows can be combined using theshown graphical interface to programmatically define a workflow. A usermay initiate execution of a workflow by selecting a desired workflow insection 1110 and clicking play button 1150.

Although the foregoing embodiments have been described in some detailfor purposes of clarity of understanding, the invention is not limitedto the details provided. There are many alternative ways of implementingthe invention. The disclosed embodiments are illustrative and notrestrictive.

What is claimed is:
 1. A method of provisioning an Internet Protocoladdress, comprising: receiving a request to provision an InternetProtocol address to a virtual resource; automatically determining anInternet Protocol address to allocate to the virtual resource, whereinautomatically determining the Internet Protocol address includesselecting the determined Internet Protocol address among a group ofInternet Protocol addresses potentially available to be assigned to thevirtual resource of the received request; using an Internet ProtocolAddress Management appliance to automatically allocate the determinedInternet Protocol address to the virtual resource, wherein the InternetProtocol Address Management appliance manages Internet Protocol addressprovisioning of both virtual resources and physical resources; andautomatically registering the virtual resource with a Domain Name Systemusing the determined Internet Protocol address, wherein automaticallyregistering the virtual resource with the Domain Name System includesregistering the determined Internet Protocol address as being associatedwith a selected domain name; wherein the request is received due to acomponent action included in a group of component actionsprogrammatically defined in a workflow; wherein the workflow is definedusing a global cloud manager interface application that interfaces witha global cloud manager managing a virtual cloud that includes thevirtual resource.
 2. The method of claim 1, wherein automaticallyregistering the virtual resource with the Domain Name System includesdetermining which domain name is available to be assigned to the virtualresource among a group of eligible domain names tracked by the InternetProtocol Address Management appliance.
 3. The method of claim 1, whereinthe virtual resource includes one or more of the following: a virtualmachine, a virtual entity, a virtual device, a virtual network, avirtual switch, a virtual host adaptor, and a virtual appliance.
 4. Themethod of claim 1, wherein automatically determining the InternetProtocol address includes determining an available Internet Protocoladdress in a database of available Internet Protocol addresses managedby the Internet Protocol Address Management appliance.
 5. The method ofclaim 1, further comprising updating a database of virtual cloudinfrastructure metadata information using the determined InternetProtocol address.
 6. The method of claim 1, further comprisingautomatically de-allocating the determined Internet Protocol address atleast in part by updating a database of available Internet Protocoladdresses managed by the Internet Protocol Address Management appliance.7. The method of claim 6, further comprising automaticallyde-registering the virtual resource with a Domain Name System.
 8. Themethod of claim 1, wherein the request is received from an agent of aglobal cloud manager, and the global cloud manager manages a virtualcloud that includes the virtual resource.
 9. The method of claim 1,wherein the request identifies a range of IP address from which the IPaddress should be assigned.
 10. The method of claim 1, wherein theworkflow is at least in part defined by a user.
 11. The method of claim1, wherein the Internet Protocol Address Management appliancecommunicates with the global cloud manager interface application usingan Advanced Message Queuing Protocol message.
 12. The method of claim 1,wherein using the Internet Protocol Address Management appliance toautomatically allocate the determined Internet Protocol address includesupdating a database of available Internet Protocol addresses managed bythe Internet Protocol Address Management appliance.
 13. A method ofregistering with a Domain Name System, comprising: receiving a requestto register a virtual resource with a Domain Name System; determiningwhich domain names, if any, are available to be assigned to the virtualresource among a group of eligible domain names; selecting one of thedetermined to be available domain names as the selected domain name;automatically registering the virtual resource with the Domain NameSystem at least in part by sending a registration request to a domainname server to register the selected domain name with the virtualresource; and providing information associated with the registration ofthe virtual resource with the Domain Name System; wherein the request isreceived due to a component action included in a group of componentactions programmatically defined in a workflow; wherein the workflow isdefined using a global cloud manager interface application thatinterfaces with a global cloud manager managing a virtual cloud thatincludes the virtual resource.
 14. A system for provisioning an InternetProtocol address, comprising: a communication interface configured toreceive a request to provision an Internet Protocol address to a virtualresource; and a processor configured to automatically determine anInternet Protocol address to allocate to the virtual resource,automatically allocate the determined Internet Protocol address to thevirtual resource, and automatically register the virtual resource with aDomain Name System using the determined Internet Protocol address,wherein automatically determining the Internet Protocol address includesselecting the determined Internet Protocol address among a group ofInternet Protocol addresses potentially available to be assigned to thevirtual resource of the received request, the system manages InternetProtocol address provisioning of both virtual resources and physicalresources, and automatically registering the virtual resource with theDomain Name System includes registering the determined Internet Protocoladdress as being associated with a selected domain name; wherein therequest is received due to a component action included in a group ofcomponent actions programmatically defined in a workflow; wherein theworkflow is defined using a global cloud manager interface applicationthat interfaces with a global cloud manager managing a virtual cloudthat includes the virtual resource.
 15. The system of claim 14, whereinautomatically registering the virtual resource with the Domain NameSystem includes determining which domain name is available to beassigned to the virtual resource among a group of eligible domain namestracked by the system.
 16. A system for registering with a Domain NameSystem, comprising: a communication interface configured to receive arequest to register a virtual resource with a Domain Name System; and aprocessor configured to determine which domain names, if any, areavailable to be assigned to the virtual resource among a group ofeligible domain names, select one of the determined to be availabledomain names as the selected domain name, automatically register thevirtual resource with the Domain Name System at least in part by sendinga registration request to a domain name server to register the selecteddomain name with the virtual resource, and provide informationassociated with the registration of the virtual resource with the DomainName System; wherein the request is received due to a component actionincluded in a group of component actions programmatically defined in aworkflow; wherein the workflow is defined using a global cloud managerinterface application that interfaces with a global cloud managermanaging a virtual cloud that includes the virtual resource.
 17. Acomputer program product for provisioning an Internet Protocol address,the computer program product being embodied in a non-transitory computerreadable storage medium and comprising computer instructions for:receiving a request to provision an Internet Protocol address to avirtual resource; automatically determining an Internet Protocol addressto allocate to the virtual resource, wherein automatically determiningthe Internet Protocol address includes selecting the determined InternetProtocol address among a group of Internet Protocol addressespotentially available to be assigned to the virtual resource of thereceived request; using an Internet Protocol Address Managementappliance to automatically allocate the determined Internet Protocoladdress to the virtual resource, wherein the Internet Protocol AddressManagement appliance manages Internet Protocol address provisioning ofboth virtual resources and physical resources; and automaticallyregistering the virtual resource with a Domain Name System using thedetermined Internet Protocol address, wherein automatically registeringthe virtual resource with the Domain Name System includes registeringthe determined Internet Protocol address as being associated with aselected domain name; wherein the request is received due to a componentaction included in a group of component actions programmatically definedin a workflow; wherein the workflow is defined using a global cloudmanager interface application that interfaces with a global cloudmanager managing a virtual cloud that includes the virtual resource. 18.The computer program product of claim 17, wherein automaticallyregistering the virtual resource with the Domain Name System includesdetermining which domain name is available to be assigned to the virtualresource among a group of eligible domain names tracked by the InternetProtocol Address Management appliance.
 19. A computer program productfor registering with a Domain Name System, the computer program productbeing embodied in a non-transitory computer readable storage medium andcomprising computer instructions for: receiving a request to register avirtual resource with a Domain Name System; determining which domainnames, if any, are available to be assigned to the virtual resourceamong a group of eligible domain names; selecting one of the determinedto be available domain names as the selected domain name; automaticallyregistering the virtual resource with the Domain Name System at least inpart by sending a registration request to a domain name server toregister the selected domain name with the virtual resource; andproviding information associated with the registration of the virtualresource with the Domain Name System; wherein the request is receiveddue to a component action included in a group of component actionsprogrammatically defined in a workflow; wherein the workflow is definedusing a global cloud manager interface application that interfaces witha global cloud manager managing a virtual cloud that includes thevirtual resource.